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ABSTRACT ^ . 

A random sample of ^fourth, eighth, and eleventh grade 
Illinois students has been tested annually since 1976 by the IlHnois 
State Board of Education. This testijig program is called the Illinois 
Inventory of Educational Progress (IIEP).- This^report presents 
mathematics achievement result's of a random sample of fourth ' 
(N-6,103}, eighth (N:^10,026), €^nd eleventh grade (N-16,264} students 
tested in 1982, factor analysis results, and teacher survey 
inf ormat^ion . The 1982 testing focused on students* knowledge of 
mathematical measurement. As such, a three-vfactor model was developed 
that provides ^or three types of measurement units (nonstandard^) 
metric, and conventional), five categories of measurement skills 
(estimation, conversions within, comparisons between, selecting ^ 
and/or reading instrtJtments, and problem-solving), and five t^pes of 
measurement attributes (length, area, capacity, mass, and 
temperature). Major findings are presented in separate chapters for 
each grade level. Two conclusi'ons emerge from these results: (1) 
students perform at roughly the same level in all aspects of 
mathematical measurement tested by the HEP and (2) students are weak 
in measureinent^ In dddition,^ studepts have considerably less problems 
with the metric system than many-people think. (Copies of test 
instrtame^ts , correct answer keys, a sample teacher survey instrument, 
and other information are included in appendices.) (JN) 
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• FOREWORD - 

What follows IS an overview of the 1982 Illinois Inventory of Educational 
Progress (HEP) in mathematical meaiurenient. The tests have been 
administered by the Illinois State Board of.Education sfnce>;!976; however, 
this analytical report is in a jiew and more usable fonnat. ' 

Development of the HEP is discussecJ, and results and ^analyses of the tests 
atfflWnistered to fourth, eighth, and eleventh grade students are presented. 
It IS hoped that the- information contained here will enhance instruction in 
Illinois sqhools. ^ ' ' ' * 

While many Illinois educators contributed to theipreparation of this report, 
r-would like to especiaUy acknowledge the efforts of Dr. John A. Dossey, 
Illinois State Universfl£y, and Dr. Mervin M. Brennan, Illinois State Board 
of Education, as the main writers. Any questions concerning' tifis report may 
be addressed to Dr.' Brennan or Dr. Thomas Kerins, Manager of the Program - 
Evaluayon and Assessment Section, Department of Planning, Research aod 
Evaluation ir Illinois State Board of 'Education. ; 



Donald G. Gill 

State Superintendent of Education 
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PREFACE 

Purpose . . " , 

The niinois Inventory of Educational Progress (HEP) is a systematic eff9rt 
by the Illinois! State Board^w Education to collect information on the 
educational ■ achievement of Illinois students in specific academic subjects 
and make that inrbrmation available to educational decision mafcfrs. ^ 

The ^three goals of the HEP are: 

1) to make available relevant, reliable, and valid data on the educational 
achievement of Illinois students:' ^ * 

^- • - 

2) to chart trends (growth, stabiltty, or decMne) in educational 
achievements over time; and ^ 

m 

3) "to publish results of research conducted in' connection with the HEP. 
Student Selection 

A random sample with two sampling stages is used to^select those students 
attending Illinois public -schools who wtll participate. 

k 

Fir§t, schools throughout the state are chosen randomly. Samples of 2,400 
fourth, eighth, and eleventh graders are then randomly^selected from lists 
of eligible students submitted by the schools. These grade levels . 
correspond roughly with the end of primary, elementary, and secondary 
educ5Lliion. (See Chapter 1 for the specia] , larger samples used in the 1982 . 
IIEI^.) 



The HEP is designed to measure group rather than individual, achievement; 
no individual student, teacher, school, or district s identified in reports. 

Type of Test 

The HEP is an objective-referenced test. Desired student performance is 
expressed i"n terms of objectives, for example: **Fourth grade students 
should be able^to recognize geometric shapes such as circles, etc:" Student 
performance is measured by test items designed to determine whether or not 
certain groups of students are able to do what the objectives state thej^^ 
should be able to do. ' ^ 

Subject Areas 

The HEP has been in existence sfnce 1976. A number of subject areas have ' 
been assessed, including, reading, writing, mathematics, science, 
citizenship, energy and nutrition, as well as student attitudes about' ■ ; 
themselves anrd education in general. \ 

"Base-line data are collected during the first year an academic subject is 
assessed.' In each succeeding year that a subject area is reassessed, 
comparisons are made between earlier and later student performance, and einy - 
growth or decline in achievenent is noted. 
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OVERVIEW 



SUMMARY OF^ llLINOIS STUDENT ACHIEVEMENT IN MATHEMATICS 



In February, 1983, the Illinois State Board of Education published a report 
entitled Student Achievement in Illinois: 'An Analysis of Student Progress . 
The report describes and synthesizes the results of six different measures 
of the achievement of Illinois students from 1970-1981^; these six tests 
include the Illinois Inventory of Educational Progress* (IIEP), Decade $tu<fy 
test {DST), ,High Schofil and^yond test (HS8), Scholastic Aptitude Test 
(SAT), American ColUssJ*" (ACT),, and The National Assessment of 
Educational Progress (NAEP),. The above-mentioned report describes these ^ 
instruments in terms of students tested, curricular areas assessed, and 
overall purpose,^ It summarizes student progress across years, from basic tfl 
advanced skills in reading, language arts, social studies, mathematics and , 
science. Here are some of the findings of " that report regarding the 
mattJematics achievement of*Illinois students, ^ * ^ 

0 yiinois students of 1981 showe(t significantly higher mathematics 
achievement than 197,6 students in* elementary school mathematics, 
* * 

0 Illinois students of 1981 showed significantly lower mathematics 
achievement than 1970 students in high school mathematics, 

0 Mathematics' achievement of Illinois high sphooT sophomores was , 
^significantly higher than the achievement of sophotoores in the 
South, jand statistically equivalent to sophomores in the rest of 
the United States oif the High School and Beyond $tu<fy test, 

0 ^"Mathematics achievement pf Illinois high school seniors on the High 
School and BeyoVid test was significantly higher than the 
^chieveitent of seniors in the South, but significantly lower than 
the achiev^ent of New York seniors. Illinois scores were 
statistically equivalent to scores of all other groups of SMiors 
across the United , States. 



Results of Correlational Analysis 



0 



Studelits who took advanced courses in mathematics tended to achieve 
higher;scores. than those who did not, v 

students whose parents showed an active ^jnterest in their academic ^ 
achievement achieved highfer'scores than thdse whose. par*ents showed 
little interest. ^ ' - 



0 students who reported low levels of test anxiety tended to achieve' 
' ^ higher^scores than students, who said tests made them quite anxious, 

0 Hales 'Scored significantly higher than females on the high school 
mathematics tests of the UEP, ACT, 'and SAT, but scores for males 
« ' and femadefe were statistically equivalent on the mathematics 
subtests of the Decade Stu(ly, * 

* * 
*o parental education level was significantly related to student 
achievement in mathematics. 

Copies of "Student /Achievement in Hli^iois: An* Analysis of Student ^ 
Progress" can be obtained from the Program Evaluation* and Assessment 
Section, Illinois State. Board of Education. 



Summary of the Present Report^ 

A random sample of fourth, eighth, and eleventh grade Illinois students has 
been tested annually sinc^ 1976 by the Illinois. State Board of Education. 
>his testing program is called'the Illinois Inventory of Educational 
Progress (HEP). This report presents student achievement results, factor ^ 
-analysis results,^ and teacher survey information* 

A thf^-factor model^ was developed for mathematical measurement. The 
model provides for three types of measurement units (nonstandard, metric, 
aid conventional ), fiVe categories of measurement skills (estimation, 
conversions wilj^in, comparisons between, selecting and/dr reading 
instruments, and problem solving), and five types of measuremeiit (length, 
area, capacity, mass, and temperature). 

The analysis of the data showed that there is only one measurement^f actor at 
'each, of the three grade levels tested.. Further analysis shewed that the 
three hypothesized factors of the measurement model^have n6 Significant 
between- or within-factor differences for student performance at any of, 
those level?. No tests were carried out for interactions of the three 
hypothesized factors of the measurement model due to the nonpropdrtional 
assignment of items to the cells of the model and the large number of blank 
cells. ^ 

description *of factor analyses Is contained -i-n Appendix 0. 

^The three-factor model was developed loy Lynn Brovm (nunols State" 
University), Oale.Jungst (Northern Illinois University), ahd Kenneth Retzer 
(Illinois State University). The model 1s described in detail In the paper 
"A Three Factor Model of Mathematical Measurement," which 1s, available upon 
request. 
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CHAPTER*! 1 



The minols Inventory of Educatlorial Progress - MaihemaUcal Measuremen^t 
Development of the 198g Mathematic? HEP ^ , 



The 1982 HEP, was designed to col IfcJjf information concerning student 
knowledge of mathematical measur^men^at grades 4, 8, and 11. As such, a 
three-factor model ^or mathematical measurement was 'developed (see Higure 
1 ). The model provides for three types of measurement units (nonstandard, 
'metric, and conventional), five categories of measurement skills ' 
(estimation, conversions within, comparisons between, 5^1 flfcting and/or 
reading Instruments, ^nd problem solving), and five types off measurement 
attributes (length, area, capaclty-j mass, and temperature^* Thg nature of 
the above factor* Uvels Is clarified by^ the information in Table 1. 
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Figure 1: The Measurement Model 
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TABLE 1 

. DESCRIPTlifti OF MODEL FACTORS AND LEVELS 

Heasureroent Units : The three types of measurement units (systems) used 
in the cpnstructlon of tfie IlEP were: ^ 

a) Nonstandard units — a system of measurement units consisting of 
defined equivalences of units not usually used foi: measurement-^in 
business or technical applications. Nonstandard units might 
involve the use of pencil lengths, eraser lengths, etc. ^ * 
* b) Metric units — ^the decimal 'system of weights and measures referred 
to as The~rnternational System of Units in which the meter, liter, 
a»d gVam are the basic units of length, capacity, and weighty ^ 
respectively. ^ ^ ' \ ' 

c) Customary units — the system referred to generally as the United 
^ ^ States customary system of weights and measures , in which the yard, 
gallon, and the avoirdupois pound are the fundamental units. for 
length, ^capacity , and weight, respectively. , 



2. He<(surement Attributes : The five types of measurement attributes 
considered in tfie itans selected for the HEP were: 

* ■ 

a) Length— the Assignment of a nuirtber to a se^ent indicating the 
distance between its endpoints. ^ ^ ^ 

b) Area— the «signment of a number^'to a boun'ded region in the plane 
indicating the number of square units" needed to cover th6 region. ' 

c) Capacity — the assignment of a number to a bounded . * ^ 
, * threti-dlmensional region indicating the amount\of space occupied by 

the rfegion, usually in terms of cubic i/nits or fluid measure. 
41 HasS" "the quaintity of matter in a bo<iy as measured by its relation. 
Wits Inertia; the weight of a bo<iy divi^ded by its acceleration 
, due to gravity; common usage refers to mass as w<sight; the quantity 
aof "heaviness" of a physical object, 
e) Temperature— the degree of hotness or coolness of anything, 

usually measured on a thermometer, such as the degree of heat in 
the atmosphere as measured on the Celsius or Fahrenheit scales. 



. Measurement Skills, : The five, types of measurement skills required to 
solve the problems were: ' . ' 

f ' ^ 

diS AEstimat1on;r "-a Judgment of the reasonable questions, information,, 
^"^nd answers necessary for dealing with a problem; "a calculated* 
approximation of what is reasonable, the range of what is 
, reasonable^ and a judgment of things not reasonable. 
' * b) Conversions Within — knowledge and computations of the cqnversion 

^ of one unit of measurement to another unit in the same system, e-g. 
100 cm - 1 m.or 12 ^in. * 1 ft. 
c) . Comparisons Between — knowledge and computations for the conversion 
* ' of .one unit in one system to a unit in a different system of 

measQrement, e.g. 1 in. - 2.54 cm.or,l li*er ^ 1.06 quarts. 
■ d) Selecting/Reading Instruments — the ability to select tlie 

' appropriate measurement device and/or <tetermine the correct type of 
unit and measure .the number by the correct lisage of the de^vice. 
> . ♦ 

ERIC . . ^ 



e) Problem Solving — the ability to determine the infd^rmation 

necessary^^to answer the problem of concern, to gather it, apply i.t, 
and arrive at 'the cirrect solution, . ' - 



Sample 



The tests were acbnintstered in the spring of 1982 to randomly dRawn' 
sample of 6,103 fourth graders, 10,026 ^ghth graders, and 16,264 eleventh 
graders. These samples were larger than the samples (2,400 per grade Tev^l) 
used other years for the HEP at the request of a number of schools. The 
results frcrni their responses on the HEP measurement items provide the data 
base for the presentations in the remainder of this document. ^ 



Teacher Sample 

In addition to the student information,* one- teacher at each^hool was 
selected by tlTe building -principal to answer a form (see. Appendix- B) which 
requested information j(in the approprfateness of the items for students in* 
that school. In particular, the teacW had to answer the following four 
questions. , - ^ ^ 

1) On a scale from 1 to 9 (1-No Student Exposure; 9-Heavy Student ' 

' Exposure), TO WHAT EXTENT HAVE STlSDENTS BEEN EXPOSED TO THE ITEM 
CONTENT? • 
' - >- 

2) On a scale from 1 to 9 (l-Not at All; 9-Very Well), HOW WELL DOES . 
' TH£ ITEM MEASURE THE CONTENT BEING TAUSHT IN- THE,4tR .(8th or 11th) 

GRADE?* ■ . '"^ 

I ■ \ ' : . 

• 3) On^ s<;ale from 1 to 9 (1-V^ry Easy; 9-Very Difficult), INDICATE ■ 

' THE OIFFICULTY OFJHE ITEM. 

4) WHAT PERCElirAGE OF STUDENTS WILL ANSi^ER THIS ITEM'cORRECTLY? 

■I . " * . . " 

T^e results of these teacher assessmeT^ts of the items serve as a measuVe of 
the validity of the items and as an aid to^ the interpretation of the student 
answer patterns. . Teacher responses to items 1 thr^gh 3 were antflyzed vta 
an analysis of the distribution of teacher responses. J^jacher responses for^ 
.each question were divided into three regions: those 0J67 standard , 
deviations below the mean of te£tcRer responses for a q.ufes^tion, those in the 
bahd + 0.67 staod^d^deviatfoRS around the mean^ and t^o^e abbve 0.&7' 
stan(|ard deviations above th6 mean. The responses in the former group wefe^ 
terfnerf low and t)iose tn the latter ^Jr-oup wereNyilled high^ TKe 0.67 _ 
standard deviati(y) iijark approximates the quartHes divisions above and below 
the mean. - - . . ^ ' ^ . 



V, 



/ 



eacher responses to item'4 concerning teacher expectations tff stujddnt 
performance were analyzed in a manner consistent with past IIEP^ ma^ematios 
assessTQents. The analysis of the discrepancies between the-tea'ch^ r 
expectations and actcial student performance. was considered on an itein by , . 
item basis using the follov/fng system of classification: 

0 Appropriate (for dii^crepancies of teR or less percentag&jg^ints^ 

between, teacher expectations and a.ctua] stu^^vt 
performance), ^ ^ /' ^ ^- 

^ 0 * Higher Than/Lower Than (for discrepancies falling in the range of^ 

]0--ZQ percentage points),^ 
0 Much Higher Than/Much Lower .Than (for discrepancies of 20 oy more ^ 

percentage points) . ^ . 

■ , • ^ . ^ 

Th;e^use of the above item analysis procedures resulted in four forms of, 
inrSniiatloti being reported for each item given to the students. These forms 
of item information which are reported in Appendix 8, are:^ 



I)/' The perc^tage q^tudents answering the iten correctly, 



[he predicted percentage of stU(Je"nt peffopance^-ven by 
teachers, ^: v^, ^ 



the 



2) ■ Xhe 

3) ' The average level of studfent exposure to the item^as reported by 

the teachers, 

4) The average difficulty level of the itm as repcfrted by t^ie - 
teachers- ' . • ^ 



4^ 
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TABLE OF SPEPIFICATIONS: HEP 1982 MATHEMATICAL MEASUREMENT z' GRADE 4 





ESTIMATfON 


f 

COMPARISONS WITHIN 


^ COMPARISONS 
BETWEEN 


SELECTION/READING 
INSTRUMENTS 


piio^LEM SOLVING 


ROW SUMS 


lenSth 


© '. 

(U) 24 
(C) 18 


■ © ' 

(M) ?2 
(C) 26 


(M) t 
(C) 


© ' 

(M) 22 
(C) 36 


•■.© ' 

(M) 23. 27 
(C) 30. 34 


' (M) 5 
(C) 5 


AREA 


* © ' 

(.M) 46 ' 

(C) 

(No) 


. © ' 

{M) • 

(C) 

(NS) 


(M) 
(C) 

(NS) 47.48 


© . 

<M) * 50. 51 
(C) 49. 53 

(Nb) 


(C) 

(f^S) 


(M) 3 
{C( 2 


CAPACITY 


0 " 

(M)' 
(C) 
(NS) 


(M) 

(C) ^8 
(NS) 


0 " 

(M) 39^ 
■(C) 
(NS) ' 


© 

(M) 43. 61 
(C) 40 
(NS) 45 


© " 

(M) 44 
(C) 42 
(NS) 


© 

(M) 4 
(C) 3 
(NS) 1 


MASS 


■ © " 

(M) 
(C) 
(NS) 


© " 

(M) 
(C) 

(NS) 54 


© " 

(M) 55 
(C)- 55 
(NSJ 


■ © ". 

(M) 60 
(C) 56. 59 
(NS) 58 


o 

{M} 57 
(C) ; 
(NS) 


© 

(M) 2(1) 
(C) 2(1) 


TEMPEfiATUfiE 


© " 

fM) 

(C) • / 


© " 

(M) 
(C) ^ 

/MCI— V 


0 " 

(M) 
(C) 


© " 

(M) 
(C) 


. 0 " 

(M) 
(C) 


■0 • 

(M) 0 
(C) 0 
(NS) 0 


COLUMN SUMS 


© 

(M) 2 
(C) 1 
(NS) 1 


■. © 

(M) 1 
(C) , 2 
tNS) 1 


© 

(M) 1 (1) 
' (C) (1) 
(NS) 4 


@ 

(M) e 
(C) e 

(NS) 5 


© 

(M) 4 

(C) 3,, ..^ , 
(NS) 0 ' ' 


® - 
m 14 (1) 

(C) 12(1) 
(NS) 11 



TABLE OF SPECIFICATIONS: HEP 1982 MATHEMATICAL MEASUREMENT GRADES 





ESTrMATION 


COMPARISONS WITHIN 


COMPARISONS 
BETWEEN 


SELECTION/REAOING 
INSTRUMENTS 


PROBLEM SOLVING 


ROW SUMS 


LENGTH 


tM) 22 
(C) 18, 
(NS) 19. 35 


© ' 

(M) 23 27. 76 
<C) 24 
(NS) 


/-N 3 

(M) 28 32 
(C) 28 30 
(NS) 


(M) 38 40 
(C) 34 
(NS) 


(M) 46 
(C) 43 67 
(NS) 


\C) 6(M 
(NS) 2 


AREA 


(M) 20 
(C) 65 
(NS) 


© ' 

(M) 26 

(C) 

(NS) 


O ' 

(M) .31 

(C) 

(NS) 


'© ' 

(M) 36 
(C) 39 
(NS) 42 


© 

(M) 44,71 
(C) 70 
(NS) 


@ 

(M) 6 
(C) 3 
(NSf 1 


CAPACITY 


© " 

(C) 

(NS) ■ • 


© ■ 

(M) 47 

fC) 

(NS) 


© 

(M) 49, 69 

(C) J69 
(NS) 


© " 

(M) 74 
(C) 51 
(NS) 53.55^ 


. ®. " 

y(M) 57 59 
(NS) 


© 

fM) 5(1}^ 
fCj 1 (1) 
(NS) 2 


MASS 


©- 

(M) 
(C) 
.(NS) 


© " 

(M) 48, 66 

(C) 

(NS) 


© " 

(M) 50 
(C) 68 ^ 
(NS) 


© " 

(M) 52 56. 75 vi- 

(C) 54 

(NS) 


(M) 58 72 
(C) 60 
(NS) 


® 

(M^ 8 
(C) 3 
(NS) 0 


TEMPERATURE 


(M) 
(C) 
(NS) 


0 " 

(M) 
(C) 
(NS) 


, ■ ©. " 

(M") 
(C) 
(NS)' 


© " 

(M) 63 ^ 
(C) 61. 62. 73 
(NS) 64 


- © " 

(M) 
(C) 
(NS) 


© 

(M) 1 
(C) 3 
(NS) 1 


COLUMN SUMS 


© 

(M) 2 
(C)- 2 
(NS) 2 


© 

(M) 7 

(C) r 

(NS) 0 


© 

(M) 4 (2) ^ 
: (C)^ 2(2) 
(NS) 0 


® 

(M) 8 
(C) 7 
(NS) 4 ^ 


(M) 7 
(C) 4 
(NS) 0 


® 

(M) 28 (2) 
(C) 16 (2) 
(NS) 6 
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TABLE OF SPECIFICATtONS: HEP 1982 MATHEMATICAL MEASUREMENT GRADE 11 





ESTIMATION 


COMPARISONS WITHIN 


/-COMPARISONS 
Qi^TWEEN 


SELECTION/READING 
INSTRUMENTS 


PROBLEM SOLVING 


how SUMS 


LENGTH 


(M) 18. 34. 38 

(C) 

(NS) 


m 20. 32. 61 
(NS) 


(M) 24. 26. 31. 66 
(C) 26. 66 
(NS) 


G) 

(M) 30, 39 
(C) 28 
' (NS) 


G) ' 

(M) 42 

(C) 22.'36 V 

(NS) . 


(M) 1 1 (2) 
(C) 3 (2) 
(NS) 0 


AflEA 


(M) 19. 69 
(C) 

(NS) , 


(M) 
(C) 
(NS) 


P) ' 
(NS) • ■ ' 


J ^- 
(M) 41 . 

(C) 

(NS) 35 * 


G) 

(M) 27 
(C) 23. 27 
(NS) 43 . 


G) 

(M) 3 (1) 
(C) 1 (1) 
(NS) 2 


CAPACITr 


(2) " 

(M) 47, 49 

(C) 

(NS) 


(2) " 
(Ml 45. 55 
(C) 

(NS) . 


•(M) 
(C) 
(NS) 


G) " 

, (M) 67 
(C) 51 
, (NS) ' 


G) 

(M) 53.57 

(C) 

(NS) 


G) 

m 7" 

(C) 1 
(NS) 0 


MASS 


(M) 
(C) 
(NS) 


(M) 

(Gt; 46 ' 
(NS) 


(M) 64 
(C) 48, 64 
(NS) 


^ G) 
(M) 50. 52. 56, 68 
'(C)' 
(NS) 


^G) ■ 

(M) 

(C) 54. 58- 
(NS) 


(M) 4(1) 
(C) 4 (1) 
(NS) 0 


TEMPERATURE 


m 

(C) 
(NS) 


(M) 

(C) 
(NS) 


(M) 

(C) 
(NS) 


G) ^ 

(M) 60, 65 
(C) 

(NS) 59, 63^«' 


G) 

(M) 63 

(C) 

(NS) 


G) ' 

(M) 3 ' 
(C) "0 ■ 
(NS) -2 . ■ 


COLUMN SUMS 


(M) 7 
(C) 0 
(NS) d 


(M) 5 
(C) 1 
(NS) 0 


(M) 2 (3) 
(C> 1 (3) 
(NS) 0 


(M) 10 
(C) 2 
(NS) 3 


G^ 

(M) -4 (1) 
(C) 5 (1) 
(NS) 1 


■ ' (35)'. 
(M) 28'{4) 
'(C) 9 (4) 
(NSr 4 



The combination af these levels of the three factors gave rise to the 75 
cells indicated by the model . ^ This model was th^n used to develop tests at 
each of the three grade levels and to gather data about student knowledge of 
mathematical measurement. Items were selected, or developed, to fiJJ^s - 
many of the cells as possible attach of the grade Vevels, while keeping the 
tests in a#close a match with the grade-Uvel curriculum as possible. 

Three tests emerged from a period of field testing and revision that took 
place in the spring of 1981 and the early fall of 1982. Copies pf the final 
tests are found in Appendix A. The .distribution of Hems on the tests to 
the cells of the model is shown in Tables 2, 3, and 4 on the fo^loviung 
/Images. The listing of some items as "comparisons between" under both metric 
faiKkjConventional indicates that the items tested comparisons between metric 
and conventional measures. 
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CHAPTER 2 
Fourth Grade Results 
Major Findings 



The analysis of the data at the fourth grade level on the three major 
factors of the model resulted In no stdfc*«t1ca1ty-^'t^pi^^ differences. 
Student performance on metric Items was not judged %^be different from 
student performance on conventional or nonstandard /ftistns. In a like manner, 
performance on the items for the five different measurement abilities ^id 
not reach statistical significance. LUceWlse^ the fourth grade student 
/Pfesponses showed no statistically si gniflcarH patterns among student 
abilities to deal vrith the Items concerning lehgth, area, capacity, or mass. 

A factor analysis was carried out to determltie the clusl^ring of items on 
the basis of IJke student performances In various areas of the test. The 
analysis identified one factor of significance. The items having loadings 
on this factor of a magnitude 0.45 or greater were, in order of descending 
magnitude: 47, 57, 59, 30, 39, 59, 31, 48, 54, and 58. An analysis of the 
origins of these Items in the model suggested. that this factor might be best 
conceptualized as a general measurement factor. None of the levels of ai)y 
of the factors of the measurement model dominated the structure of these ■ 
Items. Ho other factor* identified In the factor arralysls had an eigenvalue 
greater than one. 

In regard to "extent of student exposure," the teachers' mean rating was 
4.2025 on -a- scale from l{l,ow) to 9(h1gh). This indicated a teacher feeling 
that the studerits had had somewhat less than a*erage exposure to the topics 
on the test. Using the same rating scale, the teachers responded that the 
items sampled the measurement curriculum In their classes at an average 
level; their mean rating was 5.0855- This response provides a measure of 
the validity of the items as they are tompared to the fourth grade 
curriculum. Some Items were judged to have, a low content validity. These 
items are discussed In the report Currlcular Analysis of the 1982 
- Mathematics Results of the Illinois Inventory of Educational Progress , which 
is available from the Illinois State Board of Education. 

When asked to jydge the, difficulty levll af the test, the teachers, gave the 
test a mean rating of 5.4281 on a scale of 1 (easy) to 9(hard). This 
Indicates that the test was slightly harder than average. Student 
performance showed that the teachers are probably fairly accurate In their 
judgments. The analysis of the relationship between the Student performance 
and the teacher predictions of student performance was carried out for the 
test 1tein-bi;-1t€fn. The correlation coefficient for the relationship was 
0.72. This value is statistically significant at the O^^Ol level. The 
overall mean student perfonrance on the test was 45.5256, while the teacher 
^prediction was 47.12S6. 

The fourth grarfe test Is displayed In Appendix A. The student and teacher 
data for each Item are In Appendix B and can be matched to the Items In 
Appendix A. 
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• , CHAPTER 3^ ' 
Eighth Grade Results 
Major Findings 



The analysis of the data resulting from the student responses at the eighth 
greide indicated that tHe-tttpee factors have no significant differences among 
student performance at arv of their Vevels. This finding indicates that 
student performance was as godd on metric Items as it was on conventional 
items from a statistical standpoint. In a like manner, the^flve different 
measurement abilities did not have any significant differences in terms of 
student performance on Items measuring' thejr use. Students also showed ^o 
significant differences in their ability to de^j with length, area, 
capacity, mass, or temperature. ^ ; 

Ho tests were carried out for Interactions of the three factors of the 
measurement model due to the nonproportlonal assignment of Items to the 
cells of the model and the large number of ^lank cells. 

A factor analysis was, carried out determine the clustering ^T^items on 
the basis of like student performances on those Items. The factor analysis 
identified a single factor. The items^havlng loadings on this factor of 
absolute value 0.5 or greater were numbers 74, 72, 75, 7>, 23, 67, 62, 55, 
42, 40, and 36. An ajialysis o'^f the It^s suggested that the factor might be 
representing the ability to select/read Instruments. Items from both areas 
were represented In the Item set; so no finer analysis was made. No other 
'factors had eigenvalues greater than one. f . 

Teacher ratings of items In regard to extent of student exposure showed a 
mean rating of 5.3331 on a scale of 1 to 9. Thl6 was* an average rating. 
Usipg the same rating scale, the teachers* rating for how well the Items 
measured content covered In the classroom was 5.5615. This response 
provides some measure of validity of the |test items. Seve»*al items were 
judged ^as having low content validity when measured against the curriculum. 
These Items are discussed In the report Currlcul ar Analysis of the 1982r 
Mathematics Results of the Illinois Inventory of Educatlona^l ProgressT whIch 
Is available from the Illinois State Board of Education. , When asked to 
judge the difficulty of the Items, the teachers^ gave the test a mean rating 
of 4.6395 on a 1-easy to 9-diff1cult scale. This Indlcates'that they felt 
the items were slightly easier than average. Student performance showed 
that the eighth grade teachers were perhaps a bit optimistic. The teachers* 
prediction was 56.5056; student average perforinance was 46.9356. The analysl? 
of the relationship between the student performance" and teacher predictions 
of student performance was carried out for Individual Items and for the item 
set as a whole. The correl^lon coefficient for the entire, data set was 
0.6082. ^ 

The eighth'^rade test Is displayed in Appendix A, The student and teacfjer 
dat^ for each Item are in Appendix B and can be matched to the items^in 
Appendix A. 



21 

J 



> 



S CHAPTER 4 . . ■ 

X 
' ' . Eleventh Grade'Resul tS' 

Major Findings 

' ■■ ' \ ' " ■ 

' The analysis of. the data] fe suiting from the student responses at the 
V eleventh grade suggested' that the three factors^aye no significant 

- differences Tn student performance at any of theVlevels. This finding 
indicates that student performance on metric items wai equivalent to* that on 
conventional Sterns from a statistical^stjandpoint. " In a like manner, the 
-five diffferent measurement aWlities jdl(|'.not result in any significant 
differences -in terms of st^dent'^perf&ilji^hce on Items measuring their use. 
Likevtisft, students showed no s-igniflcant di f f erenq^k^;^^ thei r at^ility to deal 
' with length, areaifc^ capacity, mass, or "temperature. J*^,;- 

Mb tests were carried out for interactions of the three factorsJof the 
measurement model due to, the nonproportional assignment of 4«|em?*^ the 
cells of the model and tfte^^l^rge number of blank cells. 

^ A factor analys1i\rfas carried oat to determine the clustering of items on 
the basis of like-student performanceUn these items. The analysis showed " 
one factor 6f -significance; {The itemjOiaving loadings on this factor of 
magnitude 0.50 or greater wereViin desoending order IS", 66, 37, 55, 63^, 65, 

^ 26 , 28," ^2, 48, 21, 53, 59, 38, 45, and 46. An analysis of the origins" of 
these items in the inodel suggested that this factor might be best 
conceptualised as^ai general measurement factor. None of the levfels of'arv 
af the factprs of the measurement model dominated the structure of these 
items^— No other factor Identified in the factor analysis h^id an eigenvalue 
greater than one. \^ 

' A comparison of teacher predictions for student performance on the test 
items and the students'- actual performances were- correlated at the 0.6307 
lev6l. When teachers were asked to rate the |tems on the extent students 
had been exposed to^the items using a scale that ranged from 1 (none) to 9 
(heavy), ^thei^; mean'^V^ating was 5.4976. This indicates that the item^bank as 
a whole had* had average coverage in the classroom for eleventh graders at 
the given grade or earlier. Under 'the same measurement scale, the teachers 
. indicated that the items fell somewhat short of covering the full spectrum 
of measurement activities eleventh graders had been* exposed to by the third 
yeai; of secondary^ school. In response to "how well the items measured the 
content vtaught by^^them," the teachers' mean rating was 3.3246. This finding'^" 
is somewhat expected, especially in taking into account the more specialized 
backgrounds of some eleventh grade students in the areas of settee and 
mathematics. This is also partially an artifact of trying to ke6p the items 
^sed somewhat^comparable for 4th, 8th, andjlth grade students. The 
teachers also gave the item set an overall difficulty rating of 3.4118, 
-indicating they felt it fell more'toward the easy end of the difficulty ■ 
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spectrum. However^ final results showed that eleventh grade^ teachers 
slightly (Jverpredtcted *their>tij dents' performance. The teachers'* 
prediction was 58.04S correct,- but the students only achieved at the level 
of 52.05S. . . 

Detailed analysis of the results is contained ;in the>eport Curricular 
Analysis of the 1982 Mathematics Results of the Illinois Inventory oF~ 
Educational Progress , which m available from the Illinois State Board of 
Education. In that report thl student response patterns are discussed for 
each item^ \ . 

The eleventh grade test is displayed in Appendix A. The student/and teacher 
data for each iten are in Appendix B and can be matched to the ttems in^ 
Appendix A. ^ ; <f ^ 
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^ CH^lPTER 5 ' . * 

^ Sjufinary Discussion 

Chapters 2, 3, and 4 presented the statistical findings from the 1982 II 
tests and teacher questionnaires. The actual tests' are shown In Appendi 
followed by th6 student and teacher ^ata in Appendix 8. 



HEP 
X A 



Two conclusion emerge from the resuIts^ of tl^ 1982 data. First, studer^s 
perform at roughly the same leveH in al^ theiispects of tnathetnatVcal ' - 
measurement which were tested by the HEP. Student average scores y/Bre 
substantially equivalent for test items about lengttt, area, cap^acity, mass, 
and temperature. Students did equally well in estimations, conversion^ 
within a system, comparisons between systems, selection and/or reading of * 
measurement instroments, and probl^ solving. Furthermore, students did Ss 
well on metric^ problems and non-standard units as they did on customary U.S. 
units. Apparently, students have considerably less problems *with the fnetric 
system than many people think^ 1 ' 

The second conclusion Is that ft^denrs ar:e weak in measurement. Student ^ 

scores are lower in measuremenif than in every other aspect of mathematics 

except geometry. Table 5 shows comparisons for seven years of HEP data. 
. ■ 

Table 5 . ' 

Summary Performance of Fourth, Eighth, and Eleventh Grade Illinois Students 
- ^ * on the Illinois Inventory.of Educational Progress 



over Seven Years of Tests* 







Percentages Correct 




Jl 


. Grade 4 


Sfade 8 


Grade 11 


Whole Numbers 


"75% 


67% 


86% 


Mathematical Concepts 


64% 


60% 


67% 


Fractions 


-** 


68% 


63% 


Algebra 


**. 


57% 


61% 


Application* 


60% 


54% 


59%' 


Measurement (1982) 


46% 


47% \ 


52% 


Geometry 


35% 


4^% 


* 47% 


* Individual Items were averaged, then a grand me?n computed 




** indicates insufficient data 









A detailed discussion. of the 1982 HEP results Is contained in the 
curricular report mentioned in^ Chapters 2-4. The curri(»ular report goes 
over the results for each test item, displays the , percentages of students 
which selected each answer choice ilncorrect as well as correct), discusses 
what mistakes students made, and why the misjtakes were made. 

A final note should be added. Although the fourth grade measurement score 
was 18 points below that year's arithmetic score, the eighth grade score in 
measurement was only 13 points lower, and the eleventh .grade score was only 
3 percentage points below Its score in arithmetic. Measurement ability 
improves with years of schooling. 
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Answer Keys, Student Scores, and Teacher Survey Results 
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APPENDIX D 



Description of Factor Analysis 

Factor analysis Is a highly technical mathematical and statistical procedure 
which cannot be fully explained here. However; an Intuitive understanding 
of-.tagtors and -their derivation Is possible. Fred Kerllnger, In his book 
Foundations of c Behavioral 'Research (1973) wrote:' 

Factor analysis Is a method for determining the number and nature of the 
underlying variables among -large numbers of 'nieasures. 

Generally speaking, 'if two tests measure the same thing, the scores 
obtained from them can be added together. If, on the other hand, the 
two tests <So not measure the -same thing, thefr scores cannot be added 
^gether. Factor analysis tells us. In effect, what tests or measures 
cA^ be added and studied together, rather than separately. It thOs 
TTmlts the variables with which the scientist must cope^. It also (It is 
hoped) helps the scientist to locate and Identify unities or fundamental 
properties underlying tests and measures. 

A factor Is a construct, a hypothetical entity that Is assumed to 
underlie tests and test performance. A number of factors have been 
.found to underlie Intelligence, for example: verbal ability, numerical 
ability, abstract reasoning, spatial reasoning, and memory. - 

^ A Hypothetical Example 

Suppose we administer six tests to a large number of seventh grade 
pupils. Vfe suspect the six tests are npf^meisurlng^lx, but some 
smaller number of variables. Th|^l|sts are: " vocabulary'i reading, 
synpr^yms, nurrf>ers, arithmetic (stan'^dardlzed-.tests), and arithmetic 
^/'{1»acher-made tests). The names of thesedjasts 1nd1cate*'the1r nature; 
He label them respectively* V, R, S, NrASTAT. (The last tm tests, 
' though both arithmetic, have different contents and rellabtlfties. He^ 
assume a good reason for Including them both In a test battery.) After 
-the tests are adnlnlstered and scored, coefficients of correlation are 
computed between each test and every other test. We.>ay out-^^the r's In 
a correlation uatrlx (usually called R matrix). The ifiatrix Is' gi^en Iri 
Table 37.1 (Table 23). ' ^ . 



' Table 23. ' 

TAIlE 37.1 R MATRIX: COEFFICIENTS OF CORRELATION AMONG SIX TESTS 
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....How manjl^derlylng variables or factors are theret-^.The factors are 
presumed to be underlying unities between the test performances. They 
are reflected In the corret^on coefficients. If two or more tests are 
substantially correlated, ^WB^he tests share variance. They have 
c<winon factor variance. Th^jjp^ measuring something in common. 

...There are two factors. This is indicated by the clusters of r's 
clixled and labeled I and II in Table 37.1.. Note that V correlates with 
R,.72; V with S,.63; and R with S,.57. V, R, and S appear to be 
measuring something in common'. It Is Important to note,- however, that ^ 
'the tests in Cluster I, though themselves intercorrelated, ^re not to 
any great extent correlated with the tests In cluster II. Likewise, N, 
AS, and AT, though themselves intercorrelated, are not substantially 
correlated with the tests V, R, and S. What Is measured In conmon by 
the tests in Cluster I is evidently not the same as what is measured in 
common by the , tests in Cluster U. There appear to be two clusters or 
factors In the matrix. 

.For further discussion of factor anaylsis, see Kerllnger {1973, pp. 659-692) 
and- cited references. 
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APPENDIX F 



Partial Listing of Documents Available from the 

Program Evaluation and Assessment Sectlori v 

Illinois state Board of Education T' 
. November, 1982 - ^ \ 

The following Is a listing of recent publications available from the Program 
Evaluation and Assessment Section. Only those publications for which copies 
are available for distribution are Included oYt the list. Supplies are 4 
limited. In order to receive one copy of a publication, contact. the person 
listed below the doctment title. The address and phone number are: 

Illinois State Board of Education 

Program Evaluation and Assessment Section (S-284) 

100 North First Street 

Springfield, IL 62777 

(217)782-4823 

The documents are listed In chronological order by date of publication. 

Standards and Criteria Jpr the Selection of Educational Tests (1978) 
Leslie 0. Fyans, jr. ' I ■ 

15 pages. 

Adapted from 1974 American Psychological Association, American 
Educational Research. Association, and National Council for HetEisurement 
In Education publication entitled Standards for Educational and 
Psychological Tests . That manual presents comprehensive guidelines for 
selecting instruments to measure .educational grow^, achievement, and 
outcomes and Includes a subset of characteristics .absolutely necessary 
for a test to be considered acceptable; The adapted publication 
presents the essential characteristics, In a declarative sentence 
checklist format useful to district personnel In detemlning the 
acceptability of test Instrunents for local use. 

1978 Reading Item Results 

Illinois Inventory of Educational Progress (March, 1980) , 
Carmen Woods Chapman . . 
200 pages 

Presents 1978 IIEI> reading results and professional comments on the 
results. Includes purpose and goals of the statewide assessment 
program, reading objectives, student sampling model, reporting 
variables-,' and how. to Interpret the results. 

Tests Appropriate for Model A-1 in Illinois (March, 1980) 
,Rose 0. Maye 
102 pages 

Presents descriptive information concerning all nationally 'normed 
standardized achievement tests appropriate for use with Model A-1, the, 
noim-referenced model, used In evaluation of Illinois Title I programs 
in reading, language arts, and mathematics. Detailed, information 



concerning e^ch test^lncludes whether the test has an expanded standard 
score, the name given by the publisher for the e^qianded scale score, and 
whether out-of-level norms are available. 



Conference Report: Minimum Competency Testing and Handicapped students 
(April, 1980} 
C. Thomas Kerlns 



59 pages ~ 

Presents an overview of legal, programmatic, and technical Issues 
■ related to the application of mlnlmpn competency testing (MCT) ta 
•handicapped students. Based on proceedings from the State Board of 
Education MCT/Speclal Education Conference held January 3-4, 1980 In 
Chicago. * , 

A Synopsis: What Statewide or Local ^^fo'^ts Can Assure the Public That 
Students Are Appropriately Educated? (M^, 1980) 
Norman Stenzel ^ 

26 pages 

State education agency staff conducted a series of surveys to determine 
what a select panel of educators felt could be done on a statewide or 
local basis to assure the public that students are appropriately 
educated. Oe,scr1pt1on of the methodology, copies of actual 
instrumentation, and results obtained are included In the synopsis. 

A Survey: What St»fewide or Local EffoHs_Can Assure the Public That 
Student Are Appj^pnateiy Educated? iHayr T980) 
fiorman Stenzel . ^ '. 

66 pages 

' State education agency staff conducted a series of surveys to determine 
what a select panel of educators felt could be done on a statewide or 
local basis to assure the public that students are appropriately 
educated. Description of the methodology, copies of actual 
Instrumentation, and results obtained are Included In the survey report. 

Citizenship.Currlcular Analyses and Teacher Expectation Results 
Illinois Inventory of Educational Progress (June, 1980) 
Ken Redding 

27 pages 

Presents currlcular analyses by external reviewers of 1978 HEP 
citizenship results and results on the teacher expectation survey 
conducted when the test was administered. The purpose of the teacher 
survey was. to determine for each Item on the citizenship test if 
students had been exposed to the content being assessed. If the Item was 
of appropriate difficulty level, and teacher expectations of the 
percentage of students who would answer each item correctly. Includes, 
purpose and goals of the statewide assessment program; citizenship 
objectives; student sampling model; .analysis of results for each of 
grade levels four, eight, and eleven; and results for specific 
objectives. 



Annual Report on Title I. ESEA Wgrant Program. Fiscal Year 1980 (March, 1981) 
Brenda Kessin 
115 pages 



evaluator, an overview of the migrant education program, descriptions of 
and findings relevant to several special Illinois migrant projects, and 
-'site visitation surranaries based on interviews and observations at nine 
local migrant projects In Illinois. 

1980 Nutrition Report 

Illinois Inventory of Educational Progress (April, 1981) 

Carmen Woods Chapman 

27 pages ■ , 

Do scrlbos tho goals and obj o ^t4ves of the- Illinois ^! u trft1 ■ o^t Ed uGa»$^^ 
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and Training program and the Illinois Inventory of Educational . Progress 
(HEP). Outlines procedures used In developing the nutrition knowledge 
Items and presents an analysis of results obtained from fourth, eighth/ 
and eleventh grade students throughout the state. i \ _ , 

Policy Checklist: How Would You Rate Your District with Respect/ to the 
ll]1no1s state Board of Education Policy for Assessment and Stu^nt 

Aph-ievemenT? tApril, 198^) ' I 

Carmen woods Chapman 
1 page 

Includes twelve questions answered "y^s" or "no** to Indicate the extent 
to which district policy and procedures reflect state education agency 
recommendat+Ons concerning how to assess student knowledge/ability and 
determine promotion/graduation status of students. Presents forty^three 
additional questions to guide discussion of district policy at the local 
level. 

Checklist; Qualitative Review of Evaluations (April, 1981) " ; ^ 
Norman stenzel 
1 page 

Includes thirteen questions answered **yes*' or **no_** to Indicate 
qualitative strengths or weaknesses of an evaluation. The questions' 
concern the following seven components of an evaluation and rationale or 
explanation concerning each component: plan, audience, focus, 
management, data collection, analysis, and report. 

Transitional Bilingual Education In Illinois; 1979^1980 f 
Program Summary an3 Evaluation Report {Maty, 1981) 
Connie J. WUe 
168 pages ^ 

First annual evaluation report. Includes findings from data collected 
on students enrolled In Chicago and downstate transitional bilingual 
education programs in Illinois. Contents of the report can be usfed by 
local, stat^, and federal agencies In making fiscal and programmatic 
decisions. Target audiences Include personnel of districts serving 
limited-English prpflcient students (regardless of whether or not the 
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district has a state-approved bilingual education prograin)^ Institutions 
of higher education, and other agencies, as well as parent and community 
groups and legislators. 



1^?9--£nePW--Asses$TOnt' Report : 

Illinois Inventory of Educational Progress (June; 1981) 

Norman Stenzel 

39 pages ■ 

The 1979 administration of the Illinois Inventory of Educational ~ 
' Progress (IIEP) for grades four, eight, and eleven; Included' questions on 
four energy-relatecf topics: types and nature of energy., uses of energy, 
consequences of energy utilization, and conservation of energy. This •.^ 
document reports the results on the energy-related knowledge items 
aAnlnlstered at each 'of the three grade levels, as welVas on nine 



attitude Items administered at tne eignth ano -eleventh dt^ade levels. — trr 
addition, background Infontiatlon concerning the status of energy 
education In the schools based on principal- and teacher-Written " 
responses Is presented. 

Individualized Education Program Self-Audit (November, 1981) 

Nancy Spinner 

26 pages i 

Presents a. self-audit package developed and tested using 16 sites and 
over 1»000 lEPs in Illinois, when used by providers of special 
education services. Information concerning the quality of special 
education atid related services will b'e obtained. , Results from lEP 
self-audits wHl not only Indicate the extent to which requirements of 
Public Law 94-14? ^trje being met,, but will provide useful data for 
Improving lEP Implementation and demonstrating responsible and 
accountable management. ■ • - ' 

1979 Mathematics Rfesults for Fourth Grade Illinois Inventory of Educational 
Progress (November, 1981) - • ' ~ 

Mervin M. Brennan 
29 pages 

Describes development of the 1979 fourth grade IIEP mathematics test and 
presents fourth grade item results and analyses. Information provided 
should be useful In enhancing mathematics Instruction In Illinois 
schools. Includes separate Indexes of fourth grade mathematics 
objectives and Items for the 1979 IIEP, a copy of the Fourth Grade 1979' 
Mathematics Attendance Center Teacher Survey, a list of the mathematics ; 
panel members, and a list of publications describing 1979 IIEP results 
for grades four, eight, and eleven on mathematics and energy-related 
questions. 8i 

1979 Mathematics Results for Eighth Grade Illinois Inventory of Educational 
Progress iNovember, 1981) 
Mervin M. Brennan 
36 pa^s^ 
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■ Describes development of the 1979 eighth grade HEP mathematics test and 
pt*esents eighth grade item results and analyses. Information provided 
should be useful to enhance mathematics Instruction In Illinois 
schools. Includes separate Indexes of eighth grade mathematics 
objectives and items for the 1979 HEP, a copy of the Eighth Grade 1979 
Math^atlcs Attendance Cen ter Teacher Su rvey, a list of the ma thematics 
panel memoers, and d list of pubncatioris dtiscrfblriy 1979 libit* ^rtiSlil U 
. for grades four, eight, and eleven on mathematics and energy-related 
questions. * ., . 

'1979 Mathematics Results for Eleventh Grade Illinois Inventory of 

Educational Progress tNovembery 1981 ) 

nervln M. Brennan . 

34 pages » ^ 

Describes development of the 1979 eleventh grade HEP mathematics test 
and pr ese n ts e teve nth tjrade l l ei ii r esulU a nd a n .a1ys e s. — Informat+wt- 



provlded should be useful to enhance mathematics Instruction In Illinois 
schools. Includes separate Indexes of eleventh grade mathematics 
objectives and Items for the 1979 HEP, a copy of the Eleventh Gra<te 
1979 Mathematics Attendance Center Teacher Survey, a Ifst of the 
mathematics panel members, and a list of publications describing 1979 
HEP results for grades four, eight, and eleven on mathanatlcs and 
energy-related questions. 

FY 81 Annual Report on Title I, Public Law 89-313 (January, 1982) 
Connie J. Wise '. " ;' ' 

78 pages 

publication prepared annually In order to'comply with Federal Rules and 
Regulations for Title I programs and to provide descriptive and 
evaluative information concerning programs In the state. Based on data 
submitted on end-of-year sel/-assessment questionnaires by personnel of 
aliyf|scal year 1981 IlllnofsfP.L. 89-313 funded projects. 

Testing and Evaluation Reference (January, 1982) 

Rose 0. naye ^ 
10 pages ' • ■ 

A concise handbook for teachers and adnlnlstrators of Title I,^P.L.. 
89-10 proorams. Includes: (1) definitions of commonly used testing 
terms; (2) purposes of district needs assessments (Including kinds of 
data to Include and ways to organize the data); (3) selection of 
students for Title I; (4) figuring of NCE gains; (5) Interpretation of 
NCEs; (6) studly of sustained effects; (7) evaluation .of programs for 
which Model A*l Is not -appropriate; and (8) elements, of a good 
evaluation report. ' , 

Evaluation and Assessment (February, 1982) *• 

carmen woods cnapman 

6 patges ' ' ' 

Provides a true-false quiz concerning State Board and local district 
policies on evaluation and student assessment, as well as descriptions 
of successful evaluation programs being used In six local districts In ^ 
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Illinois. The, programs are more completely described In a report 
entitled "Local School District Approaches to Assessment and Evaluation. 

IIEP Roadi flg-fiepact: Results of the 1979 and 1980 Illinois Inventory of 



Educational Progress lUdrcli, l!^B^) 

Carmen Woods Chapman 
91 .pages 

1 , 'I' 

Provides an overview of the 1979 and 1980 Illinois Inventory of ^ 
Educational Progress (HEP) for fourth, eighth, and eleventh gratte 
reading. Results for each grade level and comparisons In performance 

between years and among topic areas are presented. Information . ^ 

presented can be used In developing curricula and Improving instruction 
for Il;11no1s schools. 

' ' " ^ ■ , • 

Tocal School District Approaches to Assessment'and ^Lva^uatTo^^ ^Wa^y, 1382)^ 
Carmen WQo^js Chapman 
199 pages'" 

The State Board Advisory PoVlcy on Evaluation and Assessment {adopted in 
June, 1980) encourages districts to develop arid Implement a total 
student ^issessment and evaluation program. Descriptions of programs 
being used In six Illinois districts are presented as examples of 
various approaches being used successfully throughout the state. 

Child-Find Self-Audit (June, 1982) 
Michael PTog 
37 pages ~ ' 



Presents self-audit package useful to adnlnlstrators of local education 
agencies for collecting and Interpreting Information about local 
chlfdrflnd activities. Information gathered using the package pertains 
to oBij^ the three- to five-year-old unserved (not underserved) 
population. Package is. Intended for locals use only. Results are not to 
be reported to the Illinois State Board of Education. Depending on 
local circumstances and needs, any one or more of the techniques 
presented for measuring the effectiveness of child-find programs can be 
* ut1|1z?d. Purpose of the package Is to describe methods to measure the 
effefittiveness of child-find activities, not to measure compliance with 
state or federal laws or regulations. 

Bilingual Education Mandate: A Preliminary Re_gort {June, 1982) 
/Connie o. Hise 
,46 pages - 

One of five reports prepared by Illinois State Board of Education staff 
concerning mandates placed on elementary and secondary education In 
- IlHndls. Includes discussion of the mandate for transitional bilingual 
education In terms of the stu<(y methodoljogy, a description of the 
current mandate and a historical perspective of the legislation, 
analyses of the stu<ty questions, findings and conclusions, and* 
preliminary recommendations- for action by the State Board of Education. 



Handbook for Evaluation of Special Education Effectiveness (July» 1982) 
Michael Plog ■ ' ^ \ / 

99 pages . . 

Presets -infom a tinn ahnnt nino gpparatA tArhn1q uA<^^«LJitftU_A-g_<tampl^ — 

vforksheets and other Information^ that can be used by local 
practitioners In evaluating their own special education programs. The 
handbook was designed for use by-scbool a<tn1n1strators who are 
contracting with an evaluation consultant or conducting evaluation of a 
local program and Is not Intended to be a comprehensive textbook on 
evaluation. The handbook was prepared for. use by special education 
^practitioners, but contains Information relevant to other users. 

The Use, Relevance, and Appropriateness of Tests for Educational Decision 
Making (Sep tembe r, 1982) 
Leslie d. hyans " 
124 pages 

The use, relevance, and appropriateness of tests for educational 
decision making at the local level were studied In terms of the quality 
of teacher judgment concerning test development and Implementation, 
utility of test Information to teachers, and factors affecting student 
test performance. Data were obtained -from fourth and eighth grade 
teachers and their students and ninth and eleventh grade teachers, all 
from Springfield School District #186. All participants responded to 
« paper-and-pencll instruments. The ninth grade teachers were also 
Interviewed by research assistants. 



^Stu^nt ACtnevement fn Illinois: An Analysis of student Progress { December , 

IWT — — 

C. Thomas Kerlns 
81 pages 



Describes and synthesizes the results of six different measures of 
achievement of Illinois students. The tests are the Illinois Inventory 
of Educational ProgressMlIEP), Decade Stu((y Test (DST), High School and 
Beyoffd test (HSB), Scholastic Aptitude Test (SAT), American College Test 
(ACT), and riational Assessment of Educational Progress (NAEP). The 
report provides an analysis of student progress across years, from basic 
to advanced skills in reading, language arts, social studies, 
mathematics and science. The stucfy of student achievement was conducted 
to answer three major questions; How well are Illinois students 
performing in academic areas as compared to students in other parts of 
the nation and the nation as a whole? How well are Illinois students of 
today performing in academic areas as compared to Illinois students 
during the last decade? What student and school characteristics are 
reUted to achievement of Illinois students?- 
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nunois Inventory of Educational Progress Te^ Booklets 
Doris STagle 



Fourth Grade Test Sooklet s 

T?7ffl Kathematlcs, Reading, and Citizenship 

1979: Mathematics, Reading, and Energy ' 

1980: Mathematics, ^dlng, and Nutrition 

1981: Math^natlcs, Jiading, and Science 

1982: Mathematical measurement and Reading 

1983: Mathematics, Reading, Language^Arts, and Writing 

Eighth Grade -Test Booklets 

19781 Mathematics, Reading, and Citizenship 

1979: Mathematics, Reading, and Energy ^ 

1980: Mathematics, Reading, and Nutrition % 

1981: Mathematics, Reading, and Science 

1982: Mathematical Measurement and Reading 

1983: Mathematics, Reading, Language Arts, and Writing 

Eleventh Grade Test Booklets 

1978: Mathematics, Reading, and Citizenship 

1979: Math^atlcs, Reading, and Energy 

1980: Mathesnatlcs, Reading, and Nutrition 

1981: Mathematics, Reading, and Science 

1982: Mathematical Measurement and Reading 

1983: H^themat1(;s, Reading, Language Arts, and Writing 
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